Fc> 

TR/RP NO . m 



A7 

U62 

o.80 



UNITED STATES 

NAVAL POSTGRADUATE SCHOOL 




A BAYESIAN RELIABILITY GROWTH MODEL 

by 

Stephen M . Pollock 



June 1967 



Technical Report/Research Paper No.-^ti^ 






t 



DISTRIBUTION OF THIS DOCUMENT IS UNLIMITED 




na'^al r 



raduate school 

. LIE • 93940 



UNITED STATES NAVAL POSTGRADUATE SCHOOL 
Monterey, California 



Rear Admiral E. J. O'Donnell, USN 
Superintendent 



Dr . R . F . Rinehart 
Academic Dean 



ABSTRACT: 

A model is presented for the reliability growth of a system during a 
test program. Parameters of the model are assumed to be random variables 
with appropriate prior density functions . Expressions are then derived that 
enable estimates (in the form of expectations) and precision statements (in 
the form of variances) to be made of 

. projected system reliability at time t after the start of the 
test program 

. system reliability after the observation of failure data 
Numerical examples are presented, and extension to multi-mode fail- 
ures is mentioned . 



This task was supported by: Special Projects, Code Sp-114 



Prepared by: 

Stephen M . Pollock 



Approved by: 



Released by: 



J. R. Borsting 
Chairman, Department of 
Operations Analysis 



C . E . Menneken 
Dean of 

Research Administration 



U.S. Naval Postgraduate School Technical Report/Research Paper No . ^ 

June 1967 



UNCLASSIFIED 



TABLE OF CONTENTS 



Section 






Page 


1 . 


Introduction 


1 




1.1 


Reliability Growth 


1 




1 .2 


Notation 


2 


2 . 


The 


Continuous Model 


3 




2.1 


Description 


3 




2 .2 


Some Bayesian Considerations 


6 




2 .3 


Known X and y: Reliability Projection 


8 




2 .4 


Known X and y : Reliability Inference 


12 




2 .5 


Unknown X and y : Reliability Projection 


16 




2 .6 


Unknown X and y : Reliability Inference 


20 


3. 


The 


Discrete Model 


23 




3.1 


Model Description 


23 




3.2 


Known u and v: Reliability Projection 


24 




3.3 


Known u and v : Reliability Inference 


25 




3 .4 


Unknown u and v: Reliability Projection 


29 




3.5 


Unknown u and v: Reliability Inference 


30 


4. 


Numerical Examples 


31 




4.1 


Continuous Model 


31 




4.2 


Discrete Model 


37 


5. 


Many Failure Modes 


43 




5.1 


Notational Extension 


43 


6 . 


Conclusion 


50 




6.1 


Other Models of Reliability Growth 


50 




6.2 


Conclusion 


52 



References 54 



- i - 



LIST OF ILLUSTRATIONS 



Figure 



Page 



1 



5 



Table 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 



35 

37 

38 

39 

40 

41 

43 

44 

45 

46 

47 

48 



- ii - 



1 . INTRODUCTION 



1 . 1 RELIABILITY GROWTH 

We are concerned with analyzing a particular model of reliability 
growth. The "growth" occurs in the following way: a system has some 
given value of a measure of reliability at the beginning of a length of time 
(i .e . , at the start of a test period) , and at the end of this period the value 
of this measure has changed -- hopefully, it will be improved. 

This change may be caused by a number of factors . We shall be con- 
cerned, however, with only those factors that are the result of a conscious 
effort on the part of an interested observer (the "experimenter") . This 
effort is an attempt to improve or correct the system by some physical ma- 
nipulation (such as component replacement or adjustment) or perhaps even 
by possible design change. The model considered below is similar to many 
discussed previously in the literature in that the corrections are attempted 
only after system failures have been observed. 

A comparison between the model considered here (and its implications) 
with those contained in the literature is postponed until the final sections, 
where the differences in approach should become more apparent . 

At this point we shall only mention the sort of information that should 
be, in the least, the content of any analysis of reliability growth. This 
content falls into two categories: inference and projection. In particular, 
an analysis should be able to produce statements (by necessity, probabil- 
istic ones) , on the basis of the model and the failure history to date, 
related to: 
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Inference: the present value of the reliability 



Projection: the reliability at some future time, with or without con- 
tinued application of the correction ("growth") process . 

In order to make such statements, we shall first discuss two basic models 
which allow only a single failure mode for both discretely and continuously 
failing systems . This condition will be relaxed in adapter.. section dealing 
with systems having many failure modes . 

A final comment about the use of the word "system" . As used in this 
paper, it shall mean simply a piece of equipment that has an assigned task 
to perform. If it does not perform it, it is said to have "failed" . The sys- 
tem can be very simple, containing perhaps only one component. Or it can 
be extremely complicated. The only characteristic we shall use to distin- 
guish between those degrees of complexity is the number of different (iden- 
tifiable) ways it can stop functioning: i .e . , the number of failure modes . 



1.2 NOTATION 

The following notation will be used in the description and analysis of 
the model discussed above: 

.Capital letters stand for events or states of nature. 

.An underlined variable, e .g . , x, is a random variable. 

t / \ . , , . prob . (xi xi x + ix] 

.f (x) = p.d.f. of the r.v x = lim * 1 

x — Ax 

Ax — o 

.6(x) = Dirac delta function* of x. 



'Defined most conveniently as the limit: 6(x) = lim [h(x,6)] where 



h(x,{) = <€ 0sxse 
0 otherwise 



€ — ► o 
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. P (A J B) = prob . {event A given event B has occurred] . 

.f (x|A) = p.d.f. of x given A has occurred. 

_ prob. [x s x s x + dx|A) 

Ax — o A x 

J xf^(x|A)dx = conditional expectation of x given A. 

n 2 

J [x - E(x|A)] f x (x|A)dx = conditional variance of x 
given A . 

.The letter H will be used to denote the event (state of nature) "histori- 
cal experience": all the prior knowledge that is available concerning 
the model, values of parameters of the model, etc. Probabilities and 
p.d.f.'s conditioned only upon H are called "a priori", or "prior" . 

.A vector is noted by an arrow over it , with the vector dimension being 

indicated in parentheses , e .g . , t(n) = (t,t,t, ... t ). 

i. Z o n 

2 . THE CONTINUOUS MODEL 

2.1 DESCRIPTION 

The system has a single failure mode, and the time between failures, 
t_, is a random variable (r.v.) with probability density function (p.d.f.) 

f (t ) = re rt 0 £ t £ oo . 

The parameter r is commonly called the failure rate of the system (or, 
more properly, of the particular mode of failure) . Since all relevant meas- 
ures of reliability for an exponentially failing system can be obtained from 
the failure rate, it will be sufficient to concentrate upon its characteristics 



.E(x| A) 
.V(x| A) 
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only. The exponential function is not as restrictive as it may seem at first. 
Although it is certainly a simplistic assumption to make about complex sys- 
tems ; it becomes more valid as the systems become more elementary and 
serve to comprise the components of an even greater system. In addition, 
a conceptually simple (but laborious) extension of all the results of this 
paper is possible when it is postu* ..ted that r is in fact a function of time 
since last failure . 

The system is, at any time, in one of two possible states (again, with 
respect to a single failure mode): 

U = Unrepaired State 
R = Repaired State 

The numerical value of the failure rate r depends upon which state the 
system is in: 

If the system is in the unrepaired state U, then r = X ; 

If the system is in the repaired state R, then r = p, . 

The numbers X and ^ can be any non-negative values , and in fact 
(j, .is often zero. On the other hand, the value of jj, might nob he zera . 
Thus, although the system is said to be "repaired", it might still exhibit 
failures , albeit the failure rate when repaired might be quite low . 

By virtue of a test program, the system changes states in the following 
restrictive way. After every failure, if the system is in U it 1) goes to R 
with probability a (the "repair probability"); or 2) remains in U with prob- 
ability (1-a) . If the system is in R, it remains in R with probability one. 
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Thus, there can be only one transition to state R; once the system is re- 



paired, it remains so. 

This repair attempt happens instantaneously, after which the system 
operates until the time of the next failure (this time being again a random 
variable with failure rate depending upon whether the system has been put 
into state R or has remained in state U) . 

The model may be represented by a two-state Markov process , as 
shown by the flow diagram of Figure 1 . The times between the transitions 
indicated in the diagram are the times between failures and, thus, are con- 
trolled by the failure rate of whichever state the system is in: 



a 




FIGURE 1 

Flow diagram representation of growth model 
U = Unrepaired state (failure rate - \) 

R = Repaired state (failure rate = u ) 
a = repair probability 
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Which state the system is in, i . e . , whether or not it has yet been re- 
paired, is unknown to the observer, and he can draw conclusions as to 
whether or not the system is repaired only by observing the basic data: the 
successive failure times (or, equivalently, the times between failures) . 

Finally, it is possible to allow for the system to start off in a repaired 
state by assigning 

P q = prob . (system is in R at the start of the test) . 

Except for one situation to be considered later, however, we shall always 

assume that p = 0 . 

o 

In the above model, it is easy to see that since the system ultimately* 
will go to state R, if jj, < X the failure rate of the system will eventually 
decrease, and thus the reliability will grow. On the other hand, if (for 
some unforeseen reason) jj, > X , it is possible to degrade the system re- 
liability by such a test routine . 

2 .2 SOME BAYESIAN CONSIDERATIONS 

If the numerical values of the parameters a, g, and X , defined above, 
are known, then, as will be shown, it becomes a straightforward problem to 
make probabilistic statements about the failure rate r, at any time, on the 
basis of any amount of failure information. This is essentially because the 
value of r depends only upon the state of nature (U or R) , and the transition 
from U to R is the extremely simple process shown in Figure 1 . If the values 

*As long as a ^ 0 . 
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of these parameters are unknown, however, then various methods must be 



used in order to obtain estimates of them and then, in turn, to make state- 
ments about r. This quest is, of course, within the purview of classical 
statistics, and much has been written concerning the estimation of param- 
eters of models similar to the one treated here and associated confidence 
intervals (see for example [1] ) . 

The classical approach is, in essence, to 1) define some estimator 
(of r in this case), examine it for unbiasedness , efficiency, sufficiency, 
etc.; and then to 2) define an interval, the end points of which are random 
variables derived from the observed data, which will contain the true value 
of the parameter with some pre -determined probability. 

The approach we choose to take is a purely inferential one. We state 
that before any experimentation is done the failure rates associated with 
states U and R are, respectively, the random variables X. and u, . (The 
sampling process associated with them, if one finds it necessary to imagine 
such, is the process of selecting a system to test from a batch of systems, 
the resultant picked system having associated failure rates that are thus 
random variables selected from the population consisting of all possible 
systems to be tested .) 

We shall also assume that the repair probability a is known. (An ob- 
vious extension of the model results if a is also assumed to be a random 
variable .) 
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The joint probability density function of the random variables _X and p, , 
before experimentation begins, must be given, and it is assumed that this is 
in fact known. This (most likely subjective) prior density function is defined 
to be 

f, U,n|H). 

MX 

After some experimentation and possible correction has gone on and a 

series of failure times t(n) = (t, ,t. , . . . , t ) has been noted, then use of 

12 n 

the definition of conditional probability allows one to determine the 
"posteriori" density function . 
f (X /M , | H, t(n) ) . 

A. U, 

Since the failure rate of the system at any time is a function of both X. and 
(a, , it is itself a random variable £, with its own conditional p.d.f. 

The purpose of this study is to in fact determine this density function 
for r , both at the outset of a test period and as a function of a given set 
of subsequent failure times . In addition, we shall make statements con- 
cerning the density function, and its moments, for the failure rate £ at any 
given time in the future . 

2.3 KNOWN X AND ^ : RELIABILITY PROJECTION 

Let us first suppose that X and ^ are deterministic and their exact 
numerical values are known. The failure rate £ is still a random variable, 
however, since it depends upon whether the state of nature is U or R, and 
that is itself probabilistically determined. The p.d.f. for £ is easily 
determined . 
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( 1 ) 



With a total test time of t, the p.d.f. for r_ is f (r;r) 
f (r ; t) = 6(r- \)P(U ) + 6(r- li )P(R ) 

£ T T 

where 

P(U ) = prob . {system is in U after total test time t} 

P(R ) = prob. {system is in R after total test time t] 

T 

The delta function notation is used as a convenient way to write a p.d.f. 

for the (at this point) discrete random variable _r . 

In what follows we assume that the system starts out in the unrepaired 

state P, so that p q = 0 . (The development can be easily extended when 

p ^ 0, and this will be done in a later section, where the start of the 
o 

corrective testing period , t = 0 , occurs after some previous amount of 
testing .) 

In order to calculate P(U ) = 1 - P(R ) , we note that the event (U ) 

T T T 

can be decomposed into a union of the mutually exclusive events (U ,F.) 

T 1 

where 

t h, 

(F.) = event {the transition from U to R takes place on the i failure} 
so that 

(U T ) -Q(U ,F). (2) 

i=l 

Since the F^ are mutually exclusive events , we have 

00 00 

p(u ) = r p(u , f. ) = i p(u If.) p(f. ) (3) 

T . , T 1 . , T 1 1 1 
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The number of the failure at which the transition from U to R takes place is 



geometrically distributed with parameter a, so that 



P(F.) = a(l - a) 



i-1 



(4) 



Furthermore, we see that 



th 



P(U t |F.) = prob. {system is in U at t given it goes to R at i failure) 



= prob. {less than i failures in time t while in U) 



-Z 1 
j=0 J ' 



(5) 



which all combine, to give 



P(U T ) 



a i- 1 

Z Z 
i=l j=0 



(Xt) J 
j : 



e ^ T a(l - a) 



i-1 



( 6 ) 



Changing the order of the summation gives 

P(U ) = Z Z e” XT a(l - a) 1 ” 1 

T j=0 i=j + l J * 

= Z e' XT (l -a) j = e' aXT 

j-0 '• 



(7) 



This result can be verified by noting that the rate of transition from U to R 
is aX , since 

prob. {transition from U to R in At) 

= prob. {failure in At|U) prob. {repair} 

= X A t a 

and, thus, the probability of no transition in time t is, from the Poisson 
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— ^ X T 

distribution, e . The longer derivation is useful, however, in that it 
indicates a technique to be used again below „ 

The above equations thus show that the p.d.f. of the failure rate _r at 
time t after start of testing is 

f f (r ; t) = 6(r- X)e + 6(r- M ,) (1 - e a:VT ) (8) 

Note that this expression reflects a probability statement made before 
the process starts . In other words , we can interpret the quantities 

E(.L;t) = J rf r (r, # T) = Xe a ^ T + ^ (l - e ) 
o — 

= y,+ (\-jj,)e^ (9) 



and 



V(jjt) = I “ [r - E(x; t) ] 2 f (r ;t) 
J o - 



\ 2 aX.T^_ aA.T\ /ia\ 

= (X - n) e (1 - e ) (10) 

to be the present projection of what the mean and variance of the failure rate 
X will be at time t (in the future) after corrective testing . 

These projections are useful in themselves as aids to reliability pre- 
diction. That is, if we know the values of the unrepaired and repaired 
failure rates and the value of the repair probability a, then equation (9) 
gives an estimate* of what the reliability will be at some time t after 
testing begins, and equation (10) (actually, the square root of V(r;T) ) gives 

an indication of the preciseness of that estimate . The behavior of these 

★ 

Optimal (i.e., cost-minimizing) for a quadratic loss function. 
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quantities satisfy intuition: the expectation of the failure rate starts off at 



X and approaches y . The variance starts at zero (we know r = X at t = 0) , 

and returns to zero as r — - « (r will certainly be equal to y by that time, 

as long as a ^ 0) , with an interesting maximum occurring at t = ~ . 

a X 

2.4 KNOWN X AND y: RELIABILITY INFERENCE 

All of the above analysis has been made under the consideration that 

the test was yet to be done . The analysis is extended now to the situation 

where testing has been going on for a time t, and n failures have been 

observed at times t, , t 0 , . . „ , t = t(n) , where t £ t < t , . (For ease 

1 2 n n n+1 

in notation we shall now let t = t(n) , with the understanding that the vec- 
tor is of dimension n „) 

Again, assuming still that y and X are deterministic and known, we 
would like to calculate the appropriate conditional p.d.f. for the failure 
rate: (r | t t) . To do so we shall need to calculate P(R^| t ) . This is 

shown by extending equation (1) of the preceding section, 



f r (r| t; t) = 6 (r — X ) P(U | t ) + 6(r-y) P(R | t ) 



( 11 ) 



We again make use of the events F. to write 



l 



00 



P(U I t ) = E P(U ,F. I t ) 

T ' . T 1 



00 



E P(U IF. , t ) P(F. I t ) 
i=l 



( 12 ) 
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But now we see that 



P(U |F. , t ) = prob . (the system is in U at t given it goes to R at 

t h 

the i failure, and failures are observed at 

V l 2 ' ' • " *n — *n * T < l n +l ^ 

if i ^ n 

1 if i > n (13) 

so that equation (12) becomes 



P(U | t ) = L P(F. | t ) . 

T • L1 1 
i=n+l 

Using Bayes 1 rule 

_ P(T | F ) P(F ) P(T | F. ) a(l -a) 
P(F.|t ) = 



i-1 



P( t ) 



P( t ) 



(14) 



(15) 



Under the condition that i > n (i.e. , for all terms in the sum in equation (14) ), 
th 

and in fact the i failure is observed to lie between t. and t. + dt. 

i ii 

_ -Xt -x(t -t ) -x(t -t ) -X(T-t ) 

P(t|F.)=Xe Xe .iiXe e dt dt . . . dt_ (16) 



n 



n -Xt, — 
= X e d t 



(17) 



since the times between the first n failures, given that transition to R 
* th 

occurs at some failure after the n , are identically distributed exponential 

r.v.’s with common parameter X. The last term in equation (17), e , 

is due to the fact that no failures are observed in the interval (t , t) . 

n 

Combining this result with equations (14) and (15) yields 
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(18) 



oo n -\t . \ i-1 

p(u |T) = z xe a( i' a) dt 

i=n+l P(t) 



n -Xt, »n 
X e ( 1 - a) d t 



P( t) 

We now turn our attention to calculating P(R | t ) in much the same fashion: 



P(R |T) = £ P(R ,F.|T) 

T i-1 T 1 



= £ P(R |F i , t ) P(F.| t) 

i=l 



(19) 



Here we see that 



pdgF.,0 = 



1 if i sn 



0 if i > n 



( 20 ) 



so that 



n 



P(R | t) = £ P(F | t ) 

T 1 n 1 1 

1=1 



n 



= L 



n P(t|F.)P(F.) ^P(t|F.)a(l a) 



i-1 



( 21 ) 



1=1 P(t) P(t) 

By the same arguments that lead to equation (17) we find that, when i £ n 



p , r ._. , ' X Y , - x<t i- t i-i> -“WV 

P( t | F^ ) — X e Xe .»oXe p, e 



Mi e 



-|l(t “t ) — M, ( T — t ) 

n n+1 n' 

. o . e dt,dt. . . . dt 

12 n 



. -Xt. . — m, ( t — t ,) 
i i n-i ►*' i'-r 
X e p, e d t 



(22) 
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Using this in equation (9) gives 



P(R |T) = 

<r 1 



n . -Xt. . — u, ( t— t ,) . 

„ 1 l n-i ** i /-, xi-1 ,7 

Lie (j, e a(l-a) dt 

1=1 

p(T) 



(23) 



(24) 



In order to evaluate P(t ) , the common denominator in equations (18) 
and (23) , we finally note that since (R ) and (U ) are exhaustive and 

T T 

mutually exclusive 

P(R |T) + P(U |T) = 1 

T 1 T 1 

which, by use of equations (18) and (23) gives 
P(U |T) = 1 - P(R |T) 

T i x ' 

n -Xt. .n 
_ X e (1-a) 

L( t X , n,) 

where the function L(t ; X , (x) is defined to be 

n . -Xt. . — u(t— t.) . _ 

L(t;X,|x)= r X e jj, e a(l-a) +xe (1-a) 

i=l 

= P(T)/dT (25) 

Combining all this with equation (11) gives, for the density function of the 

failure rate r , having observed failures at t, , t_, . . ., t during a test 
— 1 2 n 

period of length t: 

n . -Xt. _. — (j, ( t— t.) ._ 

6 (r-|x) L X e p, e a(l-a) +6(r-X)Xe (1-a) 

f r (r|7; t) = — — (26) 

L( t ; X , jj, ) 
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Equations (24) , (25) , and (26) are the only ones necessary to make 

inferential statements about the reliability at time t , given failures at 

times t,, t„, . . . , t , and given the values of X , u, and a . 

1 2 n ^ 

For example, let us suppose that p = 0 (a repaired system never 
fails) o Since 

oo 

E(l| t; t) = J r f r (r|T; t) dr 
0 



we find that 



E(jr | t; t) = 



— Xt , 

Xe (1 - a) 



Xe 



-M T -t n ) 



"Xt 

n , . -Xt 

ae + ( 1 - a) e 



a -X(r-t ) 

+ Xe 



(27) 



1 -a 



and 



-X(T-t n ) 



P(U It) = 1 -P(R It) = 

T 1 T 1 



a "X(T-t ) 

a + e 



(28) 



1-a 



In this case it becomes apparent that inferential statements can be made 

with only the information consisting of the length of time since the last 

failure (T-t )„ This, of course, is intuitively clear, since, if u, = 0 , at 
n 

the time of the last failure the system couldn't possibly have been repaired. 



2 o 5 UNKNOWN X AND p : RELIABILITY PROJECTION 

We come now to the more interesting and practical situation: that 
where the parameters X and p of the process are unknown at the start of 
the testing „ Inferential statements about the values of these will come in 
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the next section. Here we will be concerned with only deriving predictive 
statements analagous to those implied by equations (9) and (10) . 

The basic technique used here is to simply consider X and y. to be 
random variables \ and y, with respective p .d .f . 's f (X|H) and 
M-| H) , or possibly ajointp.d.f. f (X , p, | H ) . These a priori density 
functions are, at least at the start of experimentation, most probably sub- 
jective ones . That is, they represent all information available, at the time, 
relevant to the failure rates in question and expressed in terms of an appro- 
priate density function* . If some quantitative information is available, 
from previous tests, etc., then of course these density functions should be 
conditioned not only upon the event H, but all other observed relevant data . 

As a first step, we re-write equation (8) with the notation expanded to 
emphasize the fact that _X and are, in that equation, deterministic and 
have known values X and y , respectively. In other words, 

f r (r,-T,X,p) = f f (r ; t,A = X,t=y) 

so that 

f r (r;T, X,p) = 6(r-X)e aXr + 6(r-y) (1-e a? " T ) (29) 

We now use the well-known fact that for any probability that is itself 
conditioned so that it is a function of a realization of a r.v., i.e., 

*The best techniques for producing such subjective functions are, and will 
probably always be, subject to a great deal of controversy. We side-step 
these philosophical issues here. The interested reader is referred to the 
copious literature on the subject, for example [7] . 
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P(A|x = x) , the unconditioned probability is simply the expectation of the 

t 

conditioned one , i .e . , 

CO 

P(A) = J P(A|x= x) f x (x) dx * (30) 

r ~ 

-oo 

Using this relation, we may write in place of equation (8) 

00 00 

f r (r; t) = J J f f (r,"r, X # |x) f ^ ^ (X ,|o, | H) d X dp, . 

0 0 

In all that follows we shall assume that X and tL are independent, 
for ease of notation, so that we may write 
f. (X,n) = f. (X) f (p,) . 

A _A J-L 

The discussion, however, can be easily extended to the case when they are 

dependent variables . We shall, for convenience, also drop the conditioning 

event H, since all statements that can be made are all eventually conditioned 

upon prior experience „ 

Performing the indicated integration, we find 
00 00 

f.(r;T) = J J *[6(r-\)e aXT + 6 (r - (j,) (1-e a ^ T ) ] f^(\) M p) d^ dp, 

0 0 

= f x (r)e" arT + f (r) J (1 - e" a§ T ) f x ( 5 ) d 5 (31) 

- 0 

from which we may derive 

00 00 

E(r;T) = J ? f^(5)e" a?T d? + E(t£) J (l-e' a?T )f x (5) d§ (32) 

0 0 

*For example, see Parzen [ 1 1] p „ 336 . 
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An expression for V(r;T) may also be derived, but the specific form is 

complicated and does not provide any easy interpretation . 

As an example of the use of equation (32) , consider the case where, 

again, p, is known and is in fact equal bero (or, equivalently, it is a r.v. 

with p.d.f. f (m) = 6(p) ) . Then E(r;T) becomes, from (32) 

J± 

00 

E(jt;t) = J § f x (|)e" a5T d| (33) 

0 



The behavior of this expected value of failure rate at a time t into the 
future (under the corrective test program) can be explored by selecting an 
appropriate form for the prior p.d.f. on X . For convenience, we select 
for this prior density function the conjugate form [ 1 2] gamma distribution 






“ f * U) = 



*0-1 -ex 

Ha) 



0 5 X <= 00 
otherwise 



(34) 



which has the moments 



a 



E(A> = | 



V(x) = 



O' 



This distribution thus has enough freedom for the fitting of a desired mean 
and variance by appropriate selection of the constants a and 3. 

Putting equation (34) into (32) yields 
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= E( A) (l + it) 



st . -(a+ 1) 

P ] 



2.6 UNKNOWN X AND p : RELIABILITY INFERENCE 

The problem of inferring the value of r_ after the observation of a data 
vector t = t(n) is, of course, complicated by the fact that now A anc * 
are also random variables: A complete solution must also make inferential 
statements about the posterior distributions for these rates as well as for jr . 

These Statements , via the appropriate posterior density functions , may 
be easily made, however, by the judicial use of equation (30) . For example, 
we note that equation (24) now should be written 



The unconditional probability that the system is still in the unrepaired state 
becomes, using Bayes' Rule twice, and all limits of integration from 0 to » . 




L(t; X , ul) 



(35) 



p(U Tl t) = J J P(U T I t;A =x ,j± =m.) f (x ,m| t) dx dn 




L( t ; X , (j.) f^^(X , (j,) dX dp 
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( 36 ) 



J J K n e Xt (1 -a) n f XMi (X , p) dX dp 
J J L( t ; X , p) f (X / P) dX dp 

In addition, P(R I t) may be obtained by noting that 

T 1 

= 1 - P(R |T) (37) 

T 1 



Similarly, it may be shown that the appropriate posterior density func- 
tions for the rates X. and ju, are 
P(T |X = X) f x (x) 



f , (x 1 1 ;t) 



J p(T |x = x) f x (x) dx 

J L(7;p , X) f x (X) f^(M.) dp 
J J L(t; (j, , X) f^(X) f (p) dX dp 



and 



f (P 
1± 



_ J L(t;p , X) f x ' 

t ;t) = — = 



(X) Up) dX 



| J L(t;n ,X) f^(X) f (n) dX dp 



(38) 



(39) 



where we have let f (X , p) = f (X) f (p) for ease of notation. 

A X 

Finally, the same sort of manipulation leads to 



f r ( r | "t"; t) = 



n . -Xt, . -r(T-t.) . . 

r _ i i n-1 / i , .1-1, n -r<r,, .n 

L X e r e a(l-a) f (X ) dx + r e (1-a) 

1M ± 

J J L ( t ; X , p) f^(X) f^(p) dX d p 



(40) 



Although these equations seem formidable, they are extremely useful 
and valuable and provide all the information necessary for inferential state- 
ments about the system reliability, given an observed set of failure times . 
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In particular, knowledge of the expected values of the random variables 



_X , _y, and _r , given t , gives the experimenter good estimates of the value 
of 

a) the failure rate before testing began: equation (38) 

b) the eventual value of the failure rate after unlimited correctional 
testing: equation (39) 

c) the present value of the failure rate: equation (40) 

Additionally, the probability P(R I t ) that the system has in fact been re- 
x' 

paired is given directly by equation (37) . 

As is common in all Bayesian inference schemes , the foregoing develop- 
ment is liable, with some justification, to the criticism that the results are 

dependent upon the particular prior distributions used: f (X) and f (M>) . 

A ii 

This is indeed so, but the real concern should be with the sensitivity of the 
results to variations and/or extremes in the selection of prior functions . In 
particular, it is certainly possible to select the prior distributions with suf- 
ficiently large variances, so that the result of the analysis becomes rela- 
tively independent of the prior expectations . 

On the other hand, if the failure rates in question are to any degree 
known in advance, it seems unreasonable not to allow the analyst to make 
use of his knowledge — particularly for the making of projections . 
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3 . THE DISCRETE MODEL 



3 . 1 MODEL DESCRIPTION 

A model similar to the one discussed above is now developed for the 
case where a system exhibits "discrete" failure behavior. That is, the sys- 
temiundergoes "trials" , and at each trial the system either succeeds or fails . 
We assume that these trials are independent (the equivalent of the assump- 
tion of exponential behavior for the continuous model) . A convenient and 
appropriate measure of reliability of the system at any time is simply 
p = 1 - q, where 

p = probability {success on the next trial] 
q = probability {failure on the next trial] 

In order to model a reliability growth effect, we again consider the sys- 
tem to start in state U, from which it has probability a of making a transi- 
tion to state R after every failure . We then define the probabilities 
u = probability {system fails on a trial given in state U] 
v = probability [system fails on a trial given in state R] 

The analysis now proceeds exactly as in the preceding sections, and 
requires only some obvious notational changes (to account for the discrete 
character of the failure data) and additions . 

Let: 

x = {x. , x 0 , ... x ] = the observed data vector after n trials, 

*• 1 2 n ; 

th 

where x. = 0 or 1 as the i trial results in a failure or 
i 

success, respectively 
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i 

y. = Lx. (i = 1 , 2 , . . . n) = the cumulative number of successes 
1 k=l 1 

up to and including the i ^ trial 

z. = n - y. = the cumulative number of failures up to and including 

, ,th . , 
the l trial 



3.2 KNOWN u AND v: RELIABILITY PROJECTION 

We first consider the case where the failure probabilities u and v are 
deterministic and known. At the end of N trials, the system failure proba- 



bility is the random variable £, with p.d.f. f (q ; N) given by 
f (q;N) = 6(q-u)P(U N ) + 6(q-v) P(R R ) 



(42) 



in direct analogy with equation (l) , where 

P(Uj^) = probability {system is in U after N trials] 

P(R^) = probability {system is in R after N trials] 

The value of P(U^) is readily calculated: 

P(U^) = [probability {system not repaired after one trial] 

= [1 - probability {system is repaired after one trial] 

ri -)N 
= [1 - au] 

since all the N trials are in the U state, are independent, and a failure 
(with probability u) is necessary before a repair (probability a) is made . 
Equation (42) then becomes 

f (q ; N) = 6(q-u) (1-a u) N + 6(q-v)[l - (l-au) N ] (43) 
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The expectation of the system failure probability at the end of N trials is 



E(£; N) , where 



E(a;N) = 



q f (q ; N) dq 



a 



0 




( 44 ) 



3.3 KNOWN u AND v: RELIABILITY INFERENCE 

In order to make inferential statements about the random variable £ 
(and hence jd) given some data has been observed, we proceed again in a 
fashion similar to that used in the analysis of the continuous model . In 
particular, we may write for the conditional p.d.f. of £ , given the ob- 
served failure data vector x : 



By defining the event G.. 

(G^ = event {the transition from state U to state R takes place 



f^(q| x) = 6(q-u) P(U n | x) + 6(q-v) P(Rj x) 



(45) 



immediately after the i failure] 



we may first of all write 



00 



P(U n | X) = L P(U n , G.| x) 



i=l 



CO 



i=l 



L P(U I G. , x) P(G. I x) 
, n 1 l i 1 



(46) 
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since 



0 <U n- G il x) = (U „I X) 



i=l 



The definition of G. allows us to write 

1 



P(U n |Gi_x) = 



i £ z 



n 



1 > z 



n 



since z is the total number of failures observed in the first n trials . 
n 

Thus , if i £ z , the transition from U to R has taken place at or before 
n 

the n - trial, and the system cannot be in state U at the n trial . 

♦ 

Equation (46) can now be written 



P(Ujx) = 2 P(G.|x) 



(47) 



i=z 



n+1 



and, using Bayes' Rule, 



P(Ujx) = 



2 P(x|G.)P(G.) 

1=2 n+l 

P(x) 



The value of P(G^ is determined from the underlying geometric process 
with parameter a, so that 



l-Z 



P(x | G a ) a(l-a) 



i-1 



P(U n | x) = 



n+1 



(48) 



P(x) 
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We now note that when the transition from U to R takes place at some trial 
th 

after the n [i .e . , for all terms in the summation in equation (48) ] , we 
may write 

1-x x 1-x x 1-x x 

P(x |G.) = u (1-u) u (1-u . . . u n (l-u) n 

z y 

n. . n 
= u (1-u) 

since all n trials take place while the system is in the U state . Com- 
bining this result with equation (48) gives 

i-1 



co z y 

L u n (l-u) n a(l-a) 



P(UJ x) = 



1=Z 



n+1 



PU) 



z y z 

_ u (1-u) (1 -a) 



(49) 



P(x) 

The calculation of P(R n | x ) is also accomplished by use of the ex- 
haustive and exclusive character of the event (G. ) i = 1, 2, . . . <» . 

00 

P(Rj x) = L P(R n ,G.|x) 
i=l 



= L P(R I G. ,x) P(G. I x ) 
n 1 i l 1 

i=l 



(50) 



The value of P(R n |G, ,x ) is determined by the same arguments that led to 
equation (47): 



p ( R n |Gj.x) = 



i ^ z 



n 



(51) 



i > z 



n 
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so that equation (50) becomes 



n 



P(R I x ) = L P(G. I x ) 
n 1 . , 1 ' 

i=l 



and, using Bayes:' Rule and P(Gp = a(l-a) 



i-1 



n 



P(R n |x) = 



L P(x | G. ) a(l-a) 

i-1 l 

P(x) 



i-1 



(52) 



where the summation is defined to be zero when z = 0 . 

n 



Finally, we note that when i £ z 

1 — x 



P(x (G.) = 
5 1 



n 
1-x, 






x. 



I -i - "2 "2 1_X i i 

u ( 1 -u) u ( 1 -u) . . . u (1 -u) 



1-X X 1-X X 

1+1/, V 1+1 n,. . n 

v (1-v) . o „ v (1-v) 



i-y, y, n-i-y +y y - y . 
i/ n i / , \ ^ 1 

= u (1-u) V (1-v) 



z. y. z -z. y -y, 

i, n x 1 n 1,, v n i 

= u (1-u) v (1-v) 



(53) 



so that 



P(Rjx) = 



nz. y. z-z. y - y. 

i/, \ i ri i , . \ n i / , \ i 1 

l, u (1-u) v (1-v) a(l-a) 

i=l 

P(x) 



(54) 



Complete inferential statements about the failure probability q , given the 

observed data x , may now be readily made using the posterior p.d.f. 

f (q | x ) „ This has been obtained, essentially, since we now need to 
H. 
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simply substitute the expressions for P(U I x ) and P(R I x ) (from equa- 

n 1 n 1 

tions ( 49 ) and (54) , respectively) into equation (45) . Note that the common 
term of P(x ) in the denominators of equations (49) and (54) can be evalu- 
ated by means of 

P(U n |T) + P(Rjx) = 1 

3.4 UNKNOWN u AND v: RELIABILITY PROJECTION 

When the failure probabilities u and v are unknown, we proceed as 

in section 2.5 by treating these parameters as random variables u and v , 

with joint p.d.f. f (u,v) = f (u,v|H) . Again, we shall (for ease in 

uv uv i 

development) assume that u and v are independent, so that 

f (u , v) = f (u) f (v) 
uv u v 

Use of the technique illustrated by equation (30) gives the following 
results . (Intermediate steps have been left out. The development parallels 
that of section 2 .5) 

i> ^ 1M N 

J { 6(q-u) (1-a u) + 6(q-v) [ 1 - (1-a u) ] } f^u , v)du dv 
0 0 

= (l-aq) N f u (q) + f v (q) J [ 1 - (l-a.|) N ] f u (§) d§ ^ 55 



The projected expectation of the failure probability at the end of N trials is 



3.5 UNKNOWN u AND v: RELIABILITY INFERENCE 



When a data vector x has been observed, and u_ and v are random 
variables with prior p.d.f. f (u,v) , conditional density functions on u , 
v and C[ can be derived in a manner parallel to that used for the continuous 
case in section 2.6. 

To keep the expressions concise, we define the following terms: 



z y z 

P(U N ,x;u) = u n (l-u) n (l-a) n 



( 57 ) 



n z. y. z -z, y -y. 

P(R ,x;u,v) = L u 1 ( 1 -u) *v n 1 (l-v) n 1 a(l-a) 1 
■ n i=l 



P ( x ; u , v) = P(U ,x;u) + P(R ,x;u,v) 
n n 



( 58 ) 

( 59 ) 



P(x) = 



1 1 

u 



P( x ;u , v) f (u * v ) du dv 



( 60 ) 



The posterior density functions of interest then become (after intermediate 
steps similar to those in section 2.6) 



f u (u|x) = 



1 _ 

f P(x;u,v) f (u,v) dv 

U V 



P(x) 



( 61 ) 



f v (v|x) = 



P( x ;u , v) f (u , v) du 
_0 

P(x) 



(62) 



f £ (q|x) = 



P(R t x;u,q)f (u) du + P(U ; x ,q) 
Jq n u_ n 

P(x) 



( 63 ) 
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and the posterior probability that the system has been repaired is 



P(R n | x >. = 




n uv 



,x;u,v) f (u,v) dudv 



( 64 ) 



P(x) 



4 . NUMERICAL EXAMPLES 



4 . 1 CONTINUOUS MODEL 

A numerical example is now presented to illustrate the use of the 
results of the previous sections . 

The first task, is the assignment of appropriate prior probability density 
functions for the failure rates \ (before repair) and jx. (after repair) . In 
order to facilitate calculations it is convenient to assume that these random 
variables are independent and have prior density functions of the Gamma 
family, so that 




(65) 




( 66 ) 



Furthermore, we suppose that estimates are available for the moments 



of ij and v. A particular set of such estimates is 



E( A,) = 1 



E(lt) = .5 



(67) 



cr( A) - 1 



ct (it) - • 5 
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1 

where E( \) = J X f^(x) dX = expected value of _X 



'0 - 



V(X) = a 2 (A) = f [ X - E( _X) ] 2 f (X) dX = variance of \ 

J 0 - 

This set of estimates, in conjunction with equations (65) and (66) give 



*1 = 1 
B 1 = 1 



*2 = 1 
B 2 = 2 



The repair probability is assumed known and to have value a = .25 

These figures are selected not with a physical example in mind, but 
with the intention of displaying the underlying features of the model. Thus 
we at this point have assumed the following. 

. At the start of testing, the system has a constant failure rate X that 
is unknown, but is estimated to be about 1 (per unit time) . The precision 
of this estimate is indicated by a standard deviation of 1 (per unit time) . 

. After every failure an attempt at repair is made . This attempt has 
probability a = .25 of succeeding, i.e., putting the system in the "repaired" 
state . 

. When the system has been repaired, the failure rate decreases to a 
constant value p which is unknown, but which (from experience or judicial 
guessing) can be estimated to be .5 (per unit time) with a standard deviation 
also of .5 (per unit time) . 

We now proceed to make statements about: the failure rate after some 
length of future test time (projection); updated estimates of X and p on 
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the basis of failure data gathered during the experiment (inference); the sys- 
tem failure rate r after observation of failure data . 

Projection: 

Using the values given above, the p.d.f. for the failure rate _r at some 
time t after the start of the growth program is, from equation (31) 



f (r ; t) = e r(1+ ,25t) + 7 ^ 



Te 



- 2 r 



1 + .25t 



(68) 



and so the expected value of the failure rate after time t is, from (32) 

. 5t 



E * X) ( 1 + .25t ) + (1 + .25t) 



(69) 



From this expression we see that the expected failure rate will drop 
halfway between its unrepaired and repaired values after a length of approxi- 
mately t K 12 units . 

Inference: 

In order to make inferential statements about \ , ±1 and _r , a data 
vector is needed . 

Suppose that failures are observed, after the start of testing, at times 
1, 2, 3, 4 , 6.2, 8.2, 10. 2, so that n = number of failures = 7 and 
r= (1,2,3,4,6.2,8.2,10.2) 



[This data vector was chosen to intentionally — and crudely — simulate a 
"repair" at t = 4 and a decrease in failure rate from 1 to .5] 

For any time t, equations (38), (39) and (40) give the p.d.f. for \ , 
jx and r_, respectively; equation (36) gives the probability that the system 
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has been repaired at or before that time. In our numerical example, we can 
examine these posterior density functions by finding their means and stand- 
ard deviations . For the prior parameters and data vector given above, these 
have been calculated and are shown in Table 1 for values of t from 0 to 
10 .2 by increments of A t = .2 time units . 

Projection after Inference: 

At this point it is possible to extend the development to describe the 
following situation. 

Suppose that prior parameters have been selected, as above, and the 
inferential calculations carried out. At time t = 10 .2, after having seen 
the 7 failures described by t , what can we say about the expectation of 
the failure rate at some time t' after time t = 10.2? 

In order to answer this question we note that at time t = 10 .2 we 
have (see Table 1) 

E(\) = .917 E(yJ = .543 

ct(\) = .522 ct (mJ = .322 (70) 

P(R i2 |T) = .846 

We are now faced with the situation described in the discussion fol- 
lowing equation (1) . For we may consider the situation to be such that the 
values of equation (70) describe our total knowledge about X and up to 
that point; i.e., they can serve to define a new "prior" density function, 
with parameters , P', a* and B' 
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Doing so, we find that 



"l '■ 


1 .75 


0*2 = ^ 


?1 -■ 


1 ..22 


B ' = 3 .10 



In addition, we now have the situation where the value of 
P q = prob {system is in R at time 0} 

= P{R 12 |7) = .846 

A simple argument leads to the modification of equation (8) for the case 

when p ^ 0: 
o 

f r (r ; r ) = 6(r-X)(l-p o )e ^ XT + 6(r-m) [ l-(l-p Q )e aXr ] 
and, consequently, equation (31) becomes 



f r (r;T) 



(1-p )f (r)e 
o \ 




]f x (?)d? 



(72) 



Taking the expectation of equation (72) , using the primed prior parameters, 
we get 

E(r | t ; t 0 = expected value of failure rate time t ' after t = 12, 
given t 



«l'| h' f 1 ’ 41 “ 2 

(1 - p o>i;(^7w) + ^ 



i-(i-p 0 ) 



"i 



a. 



e/+aT # 



= .543 + 



.485( . 72 - .136 t') 
(1 .92 + .25 t '.) 2 ‘ 75 
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Sensitivity : 

The model has not been fully evaluated with regard to the sensitivity of 
results to values of the prior parameters, errors in estimation of a, etc. 
However, examples for various cases have been calculated. 

Tables 3 through 6 show E(X) , <j(X) , E(m-) , a 0-0 » P(R ) » E(r) and a(r) 

T 

all conditioned upon the data vector t= (1,2,3,4,6.2,8.2,10.2) and evalu- 
ated at t — 0 to 10 .2 by increments of At = .2 time units . These calcu- 
lations contain the prior parameters as shown in Table 2 . 



Table 


*1 


8 1 


a 2 


°2 


E(X) 


cM 


E(H) 


ct(mO 


a 


1 


1 


1 


1 


2 


1 


l 


.5 


.5 


.25 


3 


4 


4 


4 


8 


1 


.5 


.5 


..25 


.25 


4 


1 


2 


1 


4 


.5 


.5 


.25 


.25 


.25 


5 


4 


4 


4 


8 


1 


.5 


.5 


.25 


.12 


6 


4 


4 


4 


8 


1 


.5 


.5 


.25 


o 

LO 



TABLE 2 

Prior Parameters Used in Calculations of Tables 3-6 
4.2 DISCRETE MODEL 

For the discrete model, numerical calculations become simplified when 
the prior probability density functions for the failure probabilities u and v 
are of the Beta family of p .d „f s , where 

r"i / . « \ E( B ) Ofl,. iBffl /« a\ 

Blx.cB) = r(a)r(B _ a) x (1-x) (73) 
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MURES 1IIU E(\) a(M 



I 

, i-i o >r — * m tfn/' >r >o o ^ oo o n ' r*~ eg r- oj ao ^ ^ m od * 3 * O *) <n O' »r* rg a* O eg cr <© n > o ^ <*> O co in 
m> *■ m eg ^ m <xi — < o ^ a O' cr od r*- ao r- o o mm *■ *■ *■ In cn eg <\i eg -* o O O V s & <J* ® ® od oa r- r* o o >0 
pr "T >r >r Nf <r >3" n ><r o ) n > n > m n > n m <▼> m <r» co m ff> o > m n > o \ m rr> o > n > m cm eg c>* eg eg eg cm eg rg rg ig c\j rsi 



^ lt, >.j- r- ex, c u^ir nT u^r-— icxjU-' accocNj'O— «r^foo^mmr-^cjcr co f^r^vONO t^r^ccorx nt o 

>b- rw > 4 - ^ r- ^ r- j r^r-HLf'.r^^-.c'xrv.'^ o^rnrsj^o CT'C^fM^ccT' coh-NOir >r o ct^ co r- >o ir >r <r mr\ir- 

W c.\o uj r- r- e^ r- ^ ^ r- r*- r- r*- c o r^ >- c o o so so o ^o in o no o so 'r\ in u> in tn tn so m in in in in in in ur. n in 



b- 




wuM^u>HMMu\i^ujuju A ^^^LJxr^>on>inLnij>rr^u > ^p’'ingjgj'<uinN3M'gi.jr»’^Hajin^Haurnir‘>ru > <r<.> 
in >oco "><\i — <r*nn r- ir> :\r.n i^ ;n rn in ^ curj rorn >r irr-vON xtnc*,— ic\j*n>r >r <r <? uy^o >or- r^- co "x; y j' 

ogr^J(^J^»^^n>T>T>T'TNr^^u^u^Lf'.^u^<^<<'No^^^f^r^^^^^^ w r^f^^^r^aJa)aJauaJCOcxJuuaJCX^aJaJCJucuuJuucu 



^ < f c l 1 o ou i — lo <r ■ — 1 cu in rx.'LT' L^^ rxiu' r^c r 'sfjf\jcu lp <xc'c\jl^ Lr^rocr c vo ru ^aua^rjc: co a ^ ex' 

^3 Lr>j^aurLnvT>Tsr<rii>vT<rvr <ru'>r <r >rnin >r ^a-'T mo^m<\jo\jc\jcMnic\j(\jr\j^^^'^cj><->'“ -, '“ H '-^t-*C'i ocjlp CT ere > 
ixic^r^cvjtNjcNJfXjfNjcNjfxrvj t\ji>jrjr\i<^^ rsjr\i(\ifxi(Njrv^(X'fMrv’rgrNj rjf\jc\jfN J -(xi(^r\jc\jfNjrgrNjrgc^CNjPvjc\jr\j^^-‘'— » c\j 



v *' c<y a N u>r\ir-rvjr^(\.^»>r u. rvjsucj 'Tf s *H>r r^um vOCT' cmuj^nT r*-<jcn>LMj'r\jin w <r 

^3 c -oc. U'U'coci^t * ■CT'CTr* »—<«—•< r r u-i-it- trci^r r r\.^»^^.crguujr^oiroc\j«— c, u'cua^rr* 

^ u > lp, lp. j^ >r nt >r <r lp if' l^ <r >r ir ; in in in Lo tn in lh in nT vT vr 'r' tr^ in ir ^ <r vr <r ij^, <r <r vr vT 



>ou .uh^i^u^u \r- ;nji^l_j v^jivj^uj sj t\--'^'4Jvr uui\nxun w a)'i)^r^uuuju'u^ rH 'V'nM — r-u^uuu'ucju^^uj 
r-L' r ■cMrcrcr'cr'Ooajooxxa:aoocooxcor-p-r^r-^-oDcc®cooDr v -r-r-*r-r-coacoocooor~ 

>T^'^<r'TNT>T'^<r'4"<"<r>;>r^'^^r^^'r^r^^rn^ror r ir^roi(r>^^^rnr 0 rof^^^rororororr 1 rnrPrO(^ 



< v ij^ v_ r 'u(\i(^'ur > 'U^^ r ^-xc:u - >*-^'Tr^rNjr^r»H - .'*cu^j>T<r ^a > r*-u^>j'r , ^rsjr\j^^<\j^-<^t.>^,icro > cr'XcP 

u' •. r v -r , 't.^>rr\joL'x^u >r< cL''^N0Cui r '3c^( v '0'0oirir(iP'i)>ULXM'>irinin^inuuna , iru/Mnu' 1 'T>j‘>r>T'T 
U'v'COu.t. 0 s 0 s O' CP ; % CTQ S -C s 0 v c CT y N C7 > O s C' r sTC''CrC , 'C7 N CrCrC N CrC'C s C'C7 N 0 ,y O N C K C7'C7'a s C7 s O s C7'C7‘CT v C7'CT'CJ'C7 v C7'C7'Cr' 



c . O-'Cv Cwu^r-gut j' -cue jorjuennot •ooooyo^c.Qjrnocu^r 

f\iC'ua;urM>r>oco f jfx>r'C^orv l >r<;cyo(Nj>TNOc;urvj>r<jcooN<’^coQM>r'CCOOfNj>rvGaouM>rvOcoc(NJ 



^v,f\(\Nrgrnf^^nn>r >r >nr.Lr v .Lmn ip vO'O'OnO sOf^r^-P^r^f^cxD ooxoccoo' cr crcrcr oc 



ouuu^ ^^^^f\jf\jfNjf\jf\immn'. >r <r nt < r vr <r >r >r <“mtnuui'iirMr'a>aur\u^^'<jNO oo ^ do 'O'O'^r- 

i 



3 



TABLE 3 



- 38 - 



* 



F/J HIRES T I R *• E(\) ct(X) E(h) *c(h) 



! ^ ^ qs q r- p» V s o 0 s ct* ^ oo <7* ** ^4 •-< o* eg a? **r o* >r v* *r> ^ r* m cmt> m co ^ •-< r* m o 'O cn V s H 

o < 4 * tv o O' *f ^ o cr* cn ^ o o cr ^ o o 0 s oo oo r- r» 'O o m <3 \r\ in <4* >r m cn cm cnj m co oj oj ^ #-• *-* o O c* a 

^>r >T>rrn*r >r >r>T m>r ^n^^^r^n^mrnrnrnfnrnoirnp^mmmn^f^rMf^rMoimrnrnf^rnrnrnponV 



w 



m rr co >o 0 - ^ eo c. mrrrvjcNjir^ci:f-<<Njir'Oor^oo>T^HOUvO'T»- , u ,s ausOLnLrN3 , 'T>J'>^cr'a s o^c\jr^>rir. >c ar a* 
x0 m". ac sC so <r ^ • X s ^ >r (\i r xoNT^ocrNOirr oj^^r^xO^>T' s ~<’x^~ 7 s vOtf>Lr*xt‘'' 0 'CXr-r C'Xjo 
,o up ir . ^ >3- lti ip nt lt' ^ .o vt m n nT >r <- <r <r <r vj xr <r vr <r <r <r >r ro <r <r %r ^ nt <r sr ^ ' <r 



t- 



CC 



(X 



C>uxw>'T ajc>«~»eo ounuc^-hcnj^h— • MMnmNTCM*— n-uin«-HO*- cxmcjucx oj* Ksju'i^aju' (njcnj o^cn cnoo *—<<,. eno-ix 
-n vu x o oo- cr •'vvjNTjnr-j^— ^(NJxrO'^-^vr-nr^^ ^ ^r-xu'er? *nj 

cxoot\jcxmmmxTNT>T'T'T'nnLntf^«i''uuptj>oj\uoj>Gojojojojojojo-r-^'^o-r^o-o-r^o-0“.^-f^r^r-ujr- 



c »ut ch^'Thu^ • c (\j r- r' vC o >r ajo^ooinco^ir'er^rccrnaufCH. >r uj r ' a r^> a; o^ cr u \ vc ^ oj o j cn cr ir •—* cu on 

ir\ir>u^uAu^>X'r>Tf^vOW^ix>>T>rr^f^>AjLnu>u N u;r w r^'^i^in^>rrnrof^^u^Ln>T>rror { xc\jrginLn>r>rrorT')pvj<Njc\i^HNr 
ex: oo oo to oj oo X oo oo x oo oo oj (xj xj oo oj cxj o^ oo cxj oo og Ovi cxj oj oo (Xj xi co oo oo ex Os! oj cxi rx oo c\j oo <xi rv <x. oo rx oo co <xj rx 



utH''UO^ Nrc-'o-'Te. lp«— ' sC/NTer^^oo^jr^^u^erNoovoerfxjvOLroH >r %£> 0 s m vD er cn xu<_’or cx mu' cx incr ooxu^jr- 

u itupu a o' n'r-r^v v’uu ;u'U'XELTfin > lo er uu’O^ r- u ' vj p' c\i r\ ' (.•u'u's^,nxu»nt<o r- ’ tv >— r— . cc 

cxjcxoooooooo xjOooooj oofx cx oo cr\ exj og r\j ogo" o' o ' ^nro ra oo exoo oo oo m ^ \ r ' . r° ro » cxjOv- m o ^ m ro rn n i ro ox r* > rr 



UM^u\o-'HU'^'^* H uu;o > '-<NiJuj».HMU'>bi\('Uf\iujNomo' o"orsr uuxi^h^i ou^'H^u^\mu^U ia\u'U\u\aiu < . 
un^coit f^-infOfx^HxT J'U v xcx;ccx , JEXncx''(^xxr-r-r-Nxxr"^'L'NOvrsOso>UsCXNU^ 

^'^r^roivj-vj-s^stxj-xrsj 4" *T >3" 0T >r C ^ ro ^ ro ro o ' o' ^ rn ^ ^ to o > ro o - ' ro cn ro rn P*"* r''. ^ 



uAr-Lrr^r-suc^cocjr^'TirersL'O' X'0'^--r;u'0"0‘'OUvr( sQO'tNjr'xr- xr^aovum^mcr oj ><r cx t_j or a: o- u o 
u*»<— icxix. r^'-»a;r^r r — e^o- O’ r>ooeocjr- oj o>u> or r^mmxr nTO' ^rncx ojpoooc xrxoo roc xoo — cx 

>T>rrornNC>u>CLrwf'r^r^o>CNCr^o^r^r^i s -r-r-r“ 0 -r-^r , --o-r-r^r^o-r--r-^-r*-r-r-r^r^r-r-r^r-o-(^r-o-r^r-r«-r^ 



' o:>'JUQC ? f jooooc)r'0(“f)f;'joo-'y)000c ,f -)f;of'r;;'nr ) ooooooooa o ~ *_>» * j r 
oo nT o cocj«xi^ sorccjFXNrvooocjroNrcxoosKTsocoooovrvCcucjoo<rx)cocjoo>roDxocxorNOoooroNro) x>cjcx 



^H^H^H^^fSjojooOsjoor^o^ror^fT' xr »r >d- >T>rLni^umnir>xO'C' 0 '>Osor^o-r-r^o-ooacooxcocrcrc>a s C N oo 



o ex * o ^ ^ ^ tx oo oo cx oj r^. rn rrs m >r >r >r >r >r >r <r >r >r >r >r u ^ in m u \ u x u '. tn u m su oj oj oj oj oj oj so so oj r- 



v\ 
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u 

b 



® 04 go cn tn oo ® co m o m *■« <o ^ co in cm o co ® m o co m <n <n a co f» *"i *1 cr r» <0 «f) •* o* co ® <*1 

. in ^ oj ^4 o cn <n ^ o cr ^ o o cr cr o cr O' ® ® r* *o ® o ® in m »run »n ^ ^ fn ^ Q fo <n cm rx oj 
^'T^'T'T'T'T'T'fn^'T'T cn<n^* rnrocn mm mnim corn im mm <nf* unco fnmfocnm corn fn com m 

I • 



oin^r NOOf^^>r^C’vroc 7 'a'rHO'coa'c\jmo' 0 <N^' 0 >r'J*-Hcrr^sC^mmmmmm>rvtm>oaoc'OfNaO' 
C- ^Oh-srcNja'O'Tfxic sO^r-KT ®rn^Ha'®'Oinm(\JOC 7 '< 3 omrgoc>cr)r^vOin>rro®r^sOi^s 3 ‘ro<\jr^r-HO>t 

W (j'crau®®ujcuxa, ci)cjja)aor^r^ ®®r-f^r^r-r-r-r^“'«Ovor^f^r-'vOvOOvONOO>OvO > 0 > 0 ' 0 O'OOn 0 n 0 v 0'0 



o ^ cvj ro >r u > r* r« i o cr r* u \ r* h^> lp a> r- <) in o ® u'v c\j o >o n i i/' u >«--•<) o in it n >r- »—• r*- cj> cni ^ ^ 

ifN^srLnvoo<NNriPr^oj'j^r-Hrrw>>ru > ir^crr-Hroijnr^®4f\j®Ln^Hf\jNrsor^a N 0'-<r^®o*--4(\j'j‘ir^>o^-®>r 
«-< r* *-« —j ^ csj cm (\j < m osj c\j (\j o ^ r ) m m m m m >r >r *r >4* ^ in u ^ >r >r in a i u ^ mm in xj x} in u ^ <j so o >o <j o xj <j <j 



^ cinoQocr© oor^uu s cDNOin^HC ,, '(^iri> 3 'rnrjCi'vornfHcrh'>rNou(^ui(\j(jaO'i)mr- «a N O s P->r f\JOr-mrt>«~icrtr 

3 uumninirsT>r>r>j-inc'r'T^ir\'T>3‘srNrijfMA'J’>r «r >j*mcn com m>rmmm coc\j c\j (\i csj ^(\j(nj csj cni <\j*-h *—••—• huh. 

t> (N <N <N <N Csj C\J (N <N (\^ fN fN CN Pvj<NOOCNCXr\jr\j(\j(N <NCN<NCN<N OX (NrN<N<N(NCN<N<N(N(NCN<N(N<N(N<N<N<N<NCN(\J(\JCvj' 



s uuooohj r-inmNon^^-iauLf^ «— »a-> ^ i aj sr OvUCNr-maj rocr in.^>o^xjrHvo.-Hinr‘-cn® mcuco® mr-<NXJ 

3 J. i. uuc-^w'u'Ct ck. ul crw'^rHL c oMN^'-'^ou^crcuuu^HHt oo^C 7 'ujxr^r^.-Ho<~:u'<J > ccaor-r w ^ 
rn in lo in ^ <r <r >r u v/m/a nt >r u^a^ininu^ininininininin>r^r >f •Tinininiriiri^vr^^^ininuMn^^ >tnt ^nTio 



>UU\UW^I^lNOU'C^lNJP'UmjriX^^l\IU'U'U^^UM^'^'^XJ^UJOU\U^Xjr^UJU'^tNNrXJ0 1 NirMU>>OUJU > «-«CnN"*--‘ 

r^unm^H>r^(\Jt;'o^c^u'xxxxr^r^vDsOsOsOLmr,tmn unimnNO^r nT >j- ^^^ininininsr^xr 'fr^xr^intntnsr 
vT>r<r^rvr<r<rvr>rsr >r rnromr^m m coco m com mm co com com com mro rococo coco rococo rococo 



<njct cj r'or^- lhc_ u\cnc\jxrc_'~cnr^Nr<^'TO^r^f^cj'*^incj'>j~^>roorn(x>r^cuxj''Tin«--ccuir\co.-HcjcQr'--xj«-H 
^ if',uf^mc«/>uf , r w ao o« in m 'L'cuvc^ m^r m<N<N*— K^c?cncNf~<*- icjcjoo' trcoc>ocr crcrcr craococo cr 

— ' u'a'occDo^^c^aDora s ^r'ja s c r '^c v oa N a'a'^cra'a'U' 0 'cra'a'C?u'a'U'U N cDQDco!?a'CDOococococoaooco 

w « 



l j X'Uuoo'joocaQ:\'ju:.ouyocooooQaoogcor^aooooocoaor;ooonrjO 

(NJ^vOXON'r'OODCN>T'i)XO(N^vOCOO(\j>T vt)®O<N'TN 0 ®O<N>T> 0 C 0 OCN>r>©®O<N>r vOCOD(\^ vOCOOCNJ 



h- ^,-i^H,-H,-H(\jCN<N<N<Ncorocncoco>3- >r >r >tuMnmmin'0'0 O'CNOO-r-r'-f'-r^®® ® ® ® CT'CT' (7* cr O'OO 



vi 

LL 1 

X 

-j oo ^^'■^•—»^<n<n cncn cnco com corn >r 'T'T<r>r<r'r<r>T'sr<rininininininininininsux3'OvC>xj'O'C>>0NG'Or-- 



^ / 
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FMLIRHS TIPE E(X) ct(X) E(m-) ct(m-) P(R ) E(r) a(r) 



0 co oo o o & eg o m co eg *o r* gj %o eg CD o m o 'O eg O' o p ^ o r- ^ m csj cr r- <4- ^ a* <o eg in 

1 <m ^ o o m <\i ^ o o C 7 ^ co oo r*- r- m ir> >r 'O' m m cm <m rsi rg ^ «-h o O o o cr ( 7 s O' ct^ 

| ^^^^^pirM<MPimp>picr>rnp>rgrgrgcgrgcgrg{g<\irgrgrg<\jcgt\i<grg<g(g<g<grg<gcgcgcg<'g#-i^*'M*-«*-g 



OO'^'T'Ornaorgi^rr sC cnjC' r^ <r oc^o<r fM’- 4 OOooo^<r <rLnvor-cDc^r>sor^~C N ^rnu' oo^Hvri^r r- 
mr\jo co om ppf\j - 'T'Cxi^C' cnr s -r\jr^oO' Xf'-'CLP xO t.rw xOifUP >t m eg c\; •— « • r -in 

xo ^ vC o u ' >u sc wo sc >o nJ la ir txx tr j' in in cn -p m in u > n*nu\ ip >r u \ un u \ *p ir\ lp u upu . a « u 



iU\Tp- Lru'r-'g' •— iuupgjr te r>-\0>x >r^»uH^i'H/ x <\jNOcrc\jirr-i/' , ^M\j'Ta>vor--u'o vU^mvoju'u'uuho! 
I* ofMsr vo xrvsT jo xr m or-co — icnjcnj nnnvT'T'T^PO'iJr^N^-r^r^^r^cc^cuco^xcucu^P'P'j' 

a^invr^u>inr^r^^r^f^xxxaja;u s u'a s u > <j s u'UP(j'c/'Cj^a > u > u > u > LPU > a N (-r'U''a'cr'u , 'i/'U'cru'Lr*u'ipu'o > i/' 



cp^c^oc>f^>r^a?^voc\jXNT^gjPir^r r 'c > ir\C''^f\JXNr*-Hr-Nr^f\i(-rNCCNju ,s NOP'*--«xiP'T^tr\o>j^cr'P- 'Tmo 
inuMmnin'Tvr xrnin'T>Tf , 'r , m>> 4 ‘> 3 , nr'^ir>r'Trnmc\jrNjc\jHH ( -ic\jrHrHHijuuotrcruoii s crcrcr'aoauxxiP 
cv 'Nj c\j cvj c\i eg pj cvj c\j c\j cvj Pxj f\i eg c\j eg cvj eg cvj eg c\j eg cvj cvj c\i pj rvj eg cvj c\j csj c\j cvj eg eg eg oo r\j *"H *—< c\j r <j «-h •—< «•—< «-h »-h *-h »-h *-h «— i 



ip cuo^aua: cMPom c\j(\ic\jc\ip co gj^rgen ip ^conm in ico ip. r-g»mg; ip cmip.nt 

« c. igji irujciT^rNtHC'i ^u , ,xj-f , 'nrsiirxr^>iU‘''Tf f n-n.'pi^vtu'^rt^^Hi ip xjju *xtp enr- . • — c a'u 

ipi^.u^inu^>rNr>r'Tu^inininNru^up^u^i^ipini^a^iPinu^iPipi^vrLniPLnL^!nint^ ) ^u^'srir\u^ininiOLf > t ir%ir l in<ru\ 



x4ju>u\r-i'-ip>j"ipu^xo>j' <\j^-h — i'-x4jvuxc/vu>3 mcMPimn icnmmcMniigtgigig«gigig<\jr-i.— inmi\j^ivj(\ji\J^Hr- ini 

l/'. fP r~4 *T sf fO H > PJ f\j f\J (\J C\J f\j «"“< *-H »— < • — J •— < —I *-H *— < *—< •— < *-H *-H r-H *-H *-H *— < *-H r-H i — 4 r— • <— » *-H *-H i-H *-H I r*H i— H »— < *— < *— ( *-H *-H r— 4 «— * « — < *-H 

<r<r<r'Tsr-Tsrvr'T<r>rsj-^> 3 '> 3 'Nj-'r>r'r'r>rsrNtNjsrNrsrvr'T<r<r'TNrNj-<r<vTxj-Nr<r<rc‘> 4 ‘vrNrsj->rsrNrvrvj' 



fM(p^r'<j<\J'0>rmc’Px]u\omc>vurn*>coocuvcu'Nrr r 'c\ J c\jc\j*-H'— * c\jc\.(\j(\j»-h->h^^«— inn^HHH^r- 'OOt »*— ' 
ix>or^p , .oxxCW>^c-»u s xajr^cJCPU'(PXCU'u s u A cru > cPL^a'U > crcj^a s u > u > c^cp^u s iPU > u > u'u s u^cpcpcrcrcr'crc-r 
cr(PXxcj(j^cpcrcr'C > o^o^in^i^crcrc^cro^crc^crcpcpcra^cru > cpcriPC^^crLP^cpcrcpo^crcrcru^crcpcr'crx 7 ' 




OO'OUOOOOOnOO^OCOOOOOOO^OOf 'OOOPOCr ^ OVJC- w) jOOOOOQjPl' f »A' 
pjsj* xooucjN'TOcoo<MsrsOaoofNJ'rvaa}0(\JTNi)aDfjf\j'TOcou(\)sr xOcuufM^T^ocoufNJvr ooouro^'UcoucNj 



^H^H^H^^rxj(vic\jr\jc\i<^mmrom^r >r 'T'Tir»i/Mninip.>o nOnO vC'Or-'( N -r'-r-r^aoaocoaoaoa' 0 ' 0 N O v C 7 'oo 



ihh i»— i •— «pjc\jrgp^pxirnp'tp^mm>j‘^ <T'T'^’ <r sr'jrNr^>Tinipg^u>u^iru>uurungjgj>ijv 0 g->'U'O>O'Ogjr^ 



TABLE 6 
- 41 - 



(it 



The moments of this function are 



E(x) = q/8 



V(x) = a 2 (i) = f (1 - f ) 



B+l 



1 



( 74 ) 



Unfortunately, even this usually "conjugate prior" form does not allow 
a closed form solution of the projection problem, as exemplified in equations 
(55) and (56) . This is not to say that specific projections cannot be made -- 
the associated numerical integrations are straightforward, but have not been 
attempted here „ 

The more interesting inferential problem may be easily evaluated, how- 
ever, and is illustrated in Tables 8 through 12 . 

The data vector is assumed to be 



where a "0" represents a failure, a "1" represents a success. Again, 
this "observed" data vector has been pre-selected to simulate an overly 
typical result that might appear if u = .5 v=.25 and repair took place 

on the 7th triql (the 4th failure) . Numerical results now simply require a 
set of prior parameters and the determination of the first and second mo- 
ments of equations (61) , (62) and (63) . 

In the calculation of a number of cases for various values of prior 
parameters, it becomes convenient to work with the success probabilities 
1-u and 1 -v , rather than u and v directly. Table 7 shows the selection 
of values of the prior parameters for 1-u and 1-v, and for the repair 
probability a . 
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Table 


E(l-u) 


ct(I-u) 


E(l-v) 


a(l-v) 


a 


8 


.5 


.2887 


.75 


.3660 


.25 


9 


..5 


.3536 


.75 


.3953 


.25 


10 


.4 


.2619 


. 6 


.4 


.25 


11 


.5 


.3536 


.75 


.3953 


.125 


12 


.5 


.3536 


.75 


.3953 


.5 



TABLE 7 

Prior Parameters Used in Calculation of Tables 8-12 



5 . MANY FAILURE MODES 
5 . 1 NOTATIONAL EXTENSION 

In order to treat the more realistic case of systems with multiple failure 
modes, we introduce a simple extended model and notation, and then show 
that this case is solved formally by a simple extension of previously ob- 
tained solutions . The development will be only for the continuous model, 
although a similar one for the discrete case can be directly obtained by 
means of a parallel analysis . 

We now assume that a system can exhibit a total of M independent 
failure modes (characterized, by definition, by their distinguishability) . 

We also assume that a repair of a mode is possible only at a repair attempt 
made after an observed failure of that mode . 

We then define, for mode i (i = 1 , 2 , . . . M) , 
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TABLE 12 



t h 

X.. = failure rate when i mode is unrepaired 

t h 

= failure rate when i mode is repaired 

t h 

a^ = probability of repairing the i mode given an attempt is made 
The entire system will have an overall failure rate r, which, by virtue 
of the exponential failure behavior of each component, is 
M 

r = I r. 
i=l 1 

where 



r. = 
1 



X. 

l 



“i 



i^ mode is unrepaired 
i t ^ 1 mode is repaired 



This last expression serves to recall that, according to our previous analysis, 

the failure rates are in themselves random variables . 

If, then, the failure rate for each mode is a random variable _r\ , with 

known p.d.f. f (r, ) [and thus known moments], we have in particular for 
— i 

the overall system 



f (r) = f (r ) * £ (r ) * • • • « < r M > 
- -1 “2 ~ M 



(75) 



where the * indicates the convolution operation. 

Because of the independence of the failure modes, and since the repair 

of any one mode is independent of the state of the others, we see that each 

of the f (r.) of equation (75) is available from expressions such as (31) 

— i 

[for projection] or (40) [for inference] . In these expressions we must only 



- 49 - 



replace the parameters (r, X, p, » a) by (r,, L, li,, a,), and note that t 
now represents the times of occurrences of i** 1 mode failures . 

To make matters even simpler for practical purposes, we note that since 
_r = £ r_ ^ , and the are independent, we can immediately write for the 
expectation and variances: 

M 

= £ E(r ) 

i=l 

2 M 2 
= a (r) = £ a (r.) 

i=l 1 

6 . CONCLUSION 
6 . 1 OTHER MODELS OF RELIABILITY GROWTH 

Discussion of the literature on reliability growth models has been 
intentionally postponed to this final section in order to facilitate compari- 
son with this paper . 

The subject of reliability improvement by means of conscious efforts on 
the part of designers, test engineers, customers, etc. has been of interest 
from the beginnings of reliability analysis . The modelling of such growth 
processes has followed, for the most part, a common procedure: formulae 
are presented that are intended to represent the growth of reliability (or the 
decrease in failure rate, etc.) as a function of time. These formulae con- 
tain unknown parameters, and it becomes a statistical problem to find appro- 
priate estimates (and confidence statements) for these parameters as a 



E(r) 



V(r) 



- 50 - 



function of observed failure data . Such methods are found, for example, in 
references [10], [3], [15] and_[8] . Sherman [14], for example, finds 
Maximum Likelihood Estimates for the repair probability a and the unre- 
paired failure probability u when it is assumed that the repaired failure 
probability v is zero „ 

Another approach is to assume that little is known about the underlying 
failure behavior of the system, and what amounts to "almost" non-parametric 
analysis is made upon eventual failure rates (or probabilities) . This is 
summarized in [1] , 

Bayesian techniques have been used only recently. A non-parametric 
Bayesian analysis of a failure probability, constrained to be only non- 
increasing in time, may be modelled by the technique shown in Samuels [13] . 
Larson [9] has extended an earlier analysis [8] to produce Bayesian esti- 
mates of parameters of a growth model, using prior distributions suggested 
by Earnest [5] . Finally, Cozzolino [4] has presented a Bayesian approach 
to a general class of growth models with regard to making minimum-cost 
decisions about length of tests and bum-in procedures . 

All of the above analyses, however, start with a basic assumption: 
that the reliability will grow (or, at least, will not decrease) in time. If 
the techniques derived previously were to be used for a system that was 
actually deteriorating (naturally, or because of well-intentioned intervention) , 
the results would be meaningless . In practice, unfortunately, there is often 
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a need to have an inferential technique that would spot such deterioration, 



as well as one equally good at determining appropriate growth character- 
istics . 

6.2 CONCLUSION 

This paper has attempted to model a process that simply considers a 
system (with regard to each failure mode) to be in either a repaired or un- 
repaired state. The failure rates in each state are known to any desired 
degree of confidence, and accumulation of failure data serves, in a natural 
way, to update the knowledge of these state parameters . The observation 
of failure data also determines the probability that the system is repaired 
(with respect to each mode) . 

The weakest points of the model seem to be the assumptions that 
. The repair probability a is known 

. Repair attempts occur only after the observation of a failure 

The first point can be overcome (at the expense of additional com- 
plexity) by considering a to be a random variable a. with appropriate 
prior p.d.f. f^(a|H) . All analysis would then include a posterior infer- 
ential p.d.f. for a^, given a data vector. 

The second point is unfortunately too much at the heart of the model . 
For many realistic systems, the assumption seems to be valid, however, 
as the tendency is not to "ruin a good thing" . 
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It should be pointed out that the model considered here is a specific 
example of a process which Howard [6] calls "Dynamic Inference" . This 
general concept is quite useful in modelling a stochastic process in which 
the underlying parameters are allowed to change according to yet another 
stochastic process . The interested reader is referred to reference [6], 
where (as becomes apparent upon studying the Tables 2-6 and 8-12) the 
statement is made, "The numerical results indicate a complexity of behavior 
that challenges intuition" . 
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